Skip to content

Replace old Spark Jar integration tests with an acceptance test#5191

Merged
andrewnester merged 3 commits into
mainfrom
acc/spark-jar-task
May 6, 2026
Merged

Replace old Spark Jar integration tests with an acceptance test#5191
andrewnester merged 3 commits into
mainfrom
acc/spark-jar-task

Conversation

@andrewnester

Copy link
Copy Markdown
Contributor

Changes

Replace old Spark Jar integration tests with an acceptance test

Why

We don't need to test the matric of DBR / Java / Spark versions anymore and instead can just rely on an acceptance test for LTS DBR

Tests

Added an acceptance test which pass on both Cloud and Local

artifacts:
my_java_code:
path: ./myjar
build: "javac PrintArgs.java && jar cvfm PrintArgs.jar META-INF/MANIFEST.MF PrintArgs.class"

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

question - do we specifically want to test javac there or can we add a jar directly and then remove JDK requirement from our test suite and github workflows?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We want to make sure here that building with artifacts section actually works, that it produce the artifacts which we can later correctly reference on

Comment thread acceptance/bundle/deploy/spark-jar-task/databricks.yml.tmpl Outdated
@andrewnester andrewnester requested a review from pietern May 6, 2026 11:44
@andrewnester andrewnester temporarily deployed to test-trigger-is May 6, 2026 11:44 — with GitHub Actions Inactive
@andrewnester andrewnester temporarily deployed to test-trigger-is May 6, 2026 11:44 — with GitHub Actions Inactive
@andrewnester andrewnester merged commit e7d7525 into main May 6, 2026
22 of 23 checks passed
@andrewnester andrewnester deleted the acc/spark-jar-task branch May 6, 2026 13:39
denik pushed a commit that referenced this pull request May 20, 2026
## Changes
Replace old Spark Jar integration tests with an acceptance test

## Why
We don't need to test the matric of DBR / Java / Spark versions anymore
and instead can just rely on an acceptance test for LTS DBR

## Tests
Added an acceptance test which pass on both Cloud and Local

<!-- If your PR needs to be included in the release notes for next
release,
add a separate entry in NEXT_CHANGELOG.md as part of your PR. -->
TanishqDatabricks pushed a commit to TanishqDatabricks/cli that referenced this pull request May 22, 2026
…bricks#5191)

## Changes
Replace old Spark Jar integration tests with an acceptance test

## Why
We don't need to test the matric of DBR / Java / Spark versions anymore
and instead can just rely on an acceptance test for LTS DBR

## Tests
Added an acceptance test which pass on both Cloud and Local

<!-- If your PR needs to be included in the release notes for next
release,
add a separate entry in NEXT_CHANGELOG.md as part of your PR. -->
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants